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ABSTRACT 

We report angular correlation function ( ACF) of Lyman Break Galaxies (LBGs) with unprecedented 
statistical quality on the basis of 16,920 LBGs at z = 4 detected in the 1 deg 2 sky of the Subaru/XMM- 
Newton Deep Field. The ACF significantly departs from a power law, and shows an excess on small 
scale. Particularly, the ACF of LBGs with i' < 27.5 have a clear break between the small and 
large-scale regimes at the angular separation of ~ 7" whose projected length corresponds to the virial 
radius of dark halos with a mass of 10 11_12 Mq, indicating multiple LBGs residing in a single dark halo. 
Both on small (2" < 9 < 3") and large (40" < 9 < 400") scales, clustering amplitudes monotonically 
increase with luminosity for the magnitude range of i' = 24.5 — 27.5, and the small-scale clustering 
shows a stronger luminosity dependence than the large-scale clustering. The small-scale bias reaches 
b ~ 10 — 50, and the outskirts of small-scale excess extend to a larger angular separation for brighter 
LBGs. The ACF and number density of LBGs can be explained by the cold dark matter model. 
Subject headings: large-scale structure of universe — galaxies: formation — galaxies: high-redshift 



1. INTRODUCTION 

Recent observational studies have been found strong 
clustering in two-point angular correlation function 
(ACF) of Lyman break galaxies (LBGs) at z = 3 — 5, (e.g. 
Giavalisco & Dickinson 2001; Ouchi et al. 2001; Foucaud 
et al. 2003; Adelberger et al. 2003; Ouchi et al. 2004b; 
Hildebrandt et al. 2004; Allen et al. 2005), red galaxies 
at z — 3 (Daddi et al. 2003), and Lya emitters (LAEs; 
Ouchi et al. 2003; Shimasaku et al. 2004) at z = 5. Even 
at z = 6, there is a piece of evidence for filamentary 
large (100 Mpc)-scale structures of LAEs (Ouchi et al. 
2005). The distribution of high- z galaxies is fairly inho- 
mogeneous and highly biased against matter distribution 
predicted by the cold dark matter (CDM) model. The 
estimated bias is b ~ 2 — 8, depending on luminosity/type 
and redshift of galaxies. However, the shape of the ACF 
for high-z galaxies is not well constrained. Ouchi et al. 
(2001) report a 3cr excess of the ACF at 6 < 5" for z ~ 4 
LBGs, while Porciani & Giavalisco (2002) found a pos- 
sible deficit of the ACF at 10" < 9 < 30" for bright 
LBGs which they interpret as the halo exclusion effect 
on hosting halos with a mass of 10 12 M Q . 

In the local universe, the correlation function shows a 
departure from a power law (e.g. Hawkins et al. 2003; 
Zehavi et al. 2004). The departure is reproduced in the 
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framework of the halo occupation distribution (HOD) 
and the related halo models in the CDM cosmology (van 
den Bosch et al. 2003; Magliocchetti & Porciani 2003; Ze- 
havi et al. 2004; Benson et al. 2001; Berlind et al. 2003), 
and is explained by two sources contributing to the corre- 
lation function; one for galaxy pairs residing in the same 
halo (1-halo term) and the other for galaxies hosted by 
different halos (2-halo term; see, e.g., Zehavi et al. 2004). 
The HOD has been also applied to clustering of galaxies 
at high-z (Bullock et al. 2002; Moustakas & Somerville 
2002; Hamana et al. 2004). However, parameters of the 
models have not been constrained with similar accuracy 
as at \ow-z because of the small sample (100 — 2000 galax- 
ies) and surveyed area (0.01 — O.ldeg 2 ). 

In this paper, we present ACF of z — 4 LBGs with 
unprecedented statistical quality, on the basis of 16,920 
LBGs obtained in the 1 deg 2 sky of Subaru/XMM- 
Newton Deep Field (SXDF; Sekiguchi et al. 2004). 
Throughout this paper, magnitudes are in the AB sys- 
tem, and we adopt Hq = 70/i7okm s _1 Mpc -1 and 
[fi m , n, erg] — [0.3,0.7,1.0,0.9]. To facilitate compar- 
ison with previous results, we express ro using hioo, the 
Hubble constant in units of 100 km s _1 Mpc -1 . 

2. DATA AND SAMPLE 

We carried out deep optical broad-band imaging with 
Subaru/Suprime-Cam in the 1 deg 2 sky of the SXDF. 
Our broad-band images reach B ~ 28.3, V ~ 27.3, 
R ~ 27.6, i' ~ 27.5, and z' ~ 26.5 with a 2"-diameter cir- 
cular aperture at the 3u level (Furusawa et al. in prepa- 
ration). Typical seeing sizes (FWHM) of these images 
are 0".8. We use the i'-band selected source catalog of 
the SXDS Verl.O produced with SExtractor (Bertin & 
Arnouts 1996), which is composed of 0.7 million objects 
with %' < 27.5. We select LBGs at z = 4.0 ± 0.5 on the 
basis of the color criteria of Ouchi et al. (2004a), i.e., 
B-R> 1.2, R-i' < 0.7, and B - R > 1.6(i? - i 1 ) + 1.9, 
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Fig. 1.— The distribution of LBGs at z = 4.0 ± 0.5 in the 
SXDF. The red, blue, and black points denote the positions of 
the LBGs with i' < 24.5 (bright), 24.5 < i' < 26.0 (interme- 
diate), and 26.0 < i' < 27.5 (faint), respectively. The gray ar- 
eas present masked regions where we did not use for our analy- 
sis. The scale on the map is marked in both degrees and (co- 
moving) mcgaparsecs for projected distance at z = 4.0. This 
figure is degraded. This paper with the original figure 
can be downloaded from http : //www — int.stsci.edu/ ~ 
ouchi / work / astroph / sxds_zA_LBG / ouchi Jiighres .pdf 



which were determined with the results of spectroscopy 
and Monte-Carlo simulations. We visually inspect all 
the candidates and mask areas contaminated with halos 
of bright stars and CCD blooming. Our final catalog in- 
cludes 16,920 LBGs in a 1.00 deg 2 area (Table 1). Figure 
1 shows the sky distribution of our LBGs. Our spec- 
troscopic follow-up observations show that 60 out of 63 
identified candidates are real LBGs at z = 3.5 — 4.5; 
i.e., 17 out of 17 and 43 out of 46 are LBGs in the 
SXDF (Akiyama M. in preparation) and in the Subaru 
Deep Field, respectively, where the latter LBG sample 
is made with the same color criteria as ours (Yoshida 
2005). Thus, the contamination rate of our LBG sample 
is estimated to be (63 — 60)/63 = 5%. 

3. RESULTS AND DISCUSSION 
3.1. Definitive Identification of Clustering Transition 

We derive the ACF, u>(6), by the formula of Landy & 
Szalay (1993) with random samples composed of 200,000 
sources, and estimate bootstrap errors (Ling et al. 1986). 
Since clustering properties of our 5% contaminants are 
not clear, we do not apply a correction for contaminants 
with the assumption of random distribution (c.f. Ouchi 
et al. 2004b). However, this correction changes u>{ff) and 
bias only by 10% or less. Figure 2 presents the ACF of 
LBGs (top panel), residuals of a power-law fit (middle 
panel), and galaxy-dark matter bias (bottom panel) de- 
fined as b(9) = y/w{9)/udm(9), where Wdm(#) is the ACF 
predicted by the non-linear model of Peacock & Dodds 
(1996). In the top and middle panels of Figure 2 the 
ACF of LBGs shows a significant excess on small scale, 
and indicates that a power law, A^O - ^ 3 , does not fit the 
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Fig. 2.— Top : The ACF, u{9), of LBGs. The filled and open 
squares indicate the ACF with 1 <r bootstrap errors, while the 
open squares mean for ACF on very small scale which may include 
additional errors in source deblending and confusion. The solid 
line is the best-fit power law (Aoj0~ ) for 2" - 1000". The open 
circles are the ACF with IC correction under the assumption of 
the conventional power-law approximation, and the dashed lines 
are the best-fit power law for these open circles. The dotted curve 
is the ACF of dark matter predicted by the non-linear model of 
Peacock & Dodds (1996). The scale on the top axis denotes the 
projected distance in comoving megaparsecs at z = 4.0. The ticks 
labeled with R(1E10), R(1E11), R(1E12), R(1E13), and R(1E14) 
correspond to the predicted virial radii of dark halos, r200i with a 
mass of 1 X 10 10 , 10 11 , 10 12 , 10 13 , and 10 14 h^M Q , respectively. 
Middle : The ratios of the ACF to the best-fit power law for our 
LBGs (squares), together with those for local galaxies (crosses; 
Zehavi et al. 2004). Bottom : The galaxy-dark matter bias, b, 
of LBGs as a function of separation. The dashed curve presents 
bias of local galaxies (Zehavi et al. 2004). The ticks with b(lEll), 
6(1E12), and 6(1E13) show linear biases of dark halos with a mass 
of 1 X 10 11 , 10 12 , and 10 13 h^M Q , respectively, predicted by the 
CDM model of Sheth & Tormen (1999). 



data. This is the definitive identification of the depar- 
ture from a power law for the ACF of LBGs at z = 4. 
With a visual inspection, we confirm that all close-pairs 
of LBGs are not false detections. We also plot histogram 
of galaxy sizes for LBG pairs. We find that most of our 
LBGs have FWHM~ 1" for pairs with any separations 
down to, at least, ~ 2", and that extended LBGs do not 
boost small-scale ACF by producing false pairs. Uncer- 
tainties in source deblending and photometry can hardly 
account for the small-scale excess at > 2". In fact, a 
similar small-scale excess of ACF for z — 4 — 5 LBGs is 
also found by a recent study on high-resolution (~ 0".l) 
HST images (Lee et al. 2005). 

Comparing our ACF with the one of dark matter, we 
find that the small-scale excess extends up to ~ 7", i.e. 
0.24/iyQ 1 Mpc, which is comparable to virial radius, r2oo, 
of dark halos with a mass of 1O 11_12 M0 (see the ticks in 
the top panel of Figure 2), where r2oo is a sphere of radius 
within which the mean enclosed density is 200 times the 
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Fig. 3. — The ACFs of magnitude-limited subsamples of LBGs 
at z = 4.0. In the top to third-top panels, the filled symbols are 
the ACFs of our LBGs with the limiting magnitude indicated in 
the legend. Each of these panels shows the ACF of i' < 27.5 
LBGs with open squares. The dotted curves are the ACF of dark 
matter predicted by the non-linear model of Peacock & Dodds 
(1996). The thick solid and dashed lines indicate the best-fit ACFs 
of the halo model and the breakdown of 1-halo and 2-halo terms 
for each subsamplc, while the thin lines are for i' < 27.5 LBGs. In 
the bottom panels, biases of LBGs for the each magnitude-limited 
subsample are presented with the symbols which correspond to 
those marks found in the top to third-top panels. The plots of 
large-scale biases arc magnified in the inserted boxes. 



mean cosmic value (Mo & White 2002). Interestingly, the 
large-scale average bias at 40" < 9 < 400" is estimated to 
be 2.9±0.2 which is also comparable to linear bias of dark 
halos with a mass of 10 n " 12 M Q (b = 2.2-3.5) predicted 
by the CDM (Sheth & Tormen 1999; see the ticks in the 
bottom panel of Figure 2). This coincidence of the dark- 
halo mass strongly supports that typical z = 4 LBGs 
reside in dark halos with a mass of 10 11_12 M Q . More- 
over, these pieces of evidence suggest that multiple LBGs 
occupy a single dark halo. The middle panel of Figure 
2 also plots residuals of a power-law fit for local galax- 
ies (Zehavi ct al. 2004), which is comparable to those of 
z = 4 LBGs on large scale, but significantly larger than 
LBGs on intermediate scale (0.2 — 1.0 Mpc) correspond- 
ing to the radius of 10 12 ~ 14 Mq dark halos. According to 
the halo mass function (Sheth & Tormen 1999), the ratio 
of galaxy-sized halos (10 10_12 M Q ) to group/cluster-sized 
halos (1O 12_14 M ) is about 10 times higher in number 
density at z = 4 than at z = 0. This relative deficit of 
group/cluster-sized halos at high- z would be the cause 
of the clearer break between small and large-scale ACFs 
at z = 4 than z = 0. Although multiple occupation of 
LBGs explains very consistently both the angular scale 
of transition and the amplitude of large-scale bias, there 
remains the possibility that the small-scale excess is en- 
hanced or produced by brightening of pair galaxies due 
to interactions. 
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Fig. 4. — Bias and slope of z = 4 LBGs as a function of limiting- 
absolute magnitude calculated from i' — M1500 = 46.0. Top and 
middle panels present bias of small-scale (2" < 9 < 3") and large- 
scale (40" < 9 < 400") clustering. Filled circles plot for our LBGs, 
whose bias is directly measured from the ACFs. Open pentagons, 
squares, triangles, and diamonds present the large-scale (~ 8/iTqq) 
bias estimated from the conventional power-law fit by Allen et al. 
(2005); Ouchi ct al. (2004b, 2001); Arnouts et al. (2002). In the 
middle panel, the right-hand vertical scale means mass of dark 
halos corresponding to the linear bias (Sheth & Tormen 1999). The 
upper abscissa axis ticks number densities of our LBGs. Bottom 
panel shows the slope of a power law for the ACFs. Filled and 
open circles indicate the slopes for large-scale (40" < 8 < 400") 
with no IC correction (/3 L ), and for all scales (2" < 9 < 1000") 
with IC correction (/3; see Table 1), respectively. 



3.2. Luminosity Dependence of Clustering 

We calculate cu(0) and 6 for six subsamples with lim- 
iting magnitudes of i' < 24.5, 25.0, 25.5, 26.0, 26.5, and 
27.0 (Figure 3). We define the large- and small-scale bi- 
ases as the biases in the range 40" < 9 < 400" (1-10/iioo 
Mpc) and 2" < 9 < 3" (0.05 - 0.07/1^ Mpc), respec- 
tively, and show the biases in Figure 4. Although the 
angular range for the small-scale bias is somewhat arbi- 
trary, the range defined here is beyond the internal struc- 
tures of galaxies and below the radii of dark halos with 
10 11 Mq , and thus is sensitive to a multiplicity of LBGs in 
a halo. Luminosity segregation of large-scale clustering 
is reported for z = 4 LBGs (Ouchi et al. 2004b; Allen et 
al. 2005; Lee et al. 2005). In Figures 3 and 4, we find that 
ACFs and biases monotonically decrease from i' < 24.5 
to 27.5 on small scale as well as large scale. Interestingly, 
Figure 4 shows that the small-scale bias has a stronger 
dependence on luminosity (b ~ 10 — 50) than the large- 
scale bias (b ~ 3 — 4), and the bottom panels of Figure 
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3 indicate that outskirts of small-scale excess extend to 
9 ~ 10" for bright (i' < 24.5 - 25.5) LBGs. All the fea- 
tures of luminosity dependence suggest that bright LBGs 
reside in more massive dark halos, since massive dark ha- 
los have not only a high large-scale bias, but also a high 
small-scale bias (i.e. high probability of pair galaxies in 
a massive halo) and an extended outskirt of bias due to 
a large halo size. 

Although the ACFs depart from a power law, we ap- 
proximate the ACFs with a power law, in order to com- 
pare our results with previous results. We fit the ACF 
over 2-1000" with u(6) = A u (6~ -IC/A U ), where IC is 
the integral constraint (Groth & Peebles 1977). The bot- 
tom panel of Figure 4 presents the best-fit slopes, 0, as a 
function of magnitude. The slopes, 0, become flatter at 
faint magnitudes (see also Kashikawa et al. 2005). This 
luminosity dependence of is explained by the strong 
luminosity dependence of small-scale clustering as dis- 
cussed above. Then we calculate the Limber equation 
with the redshift distribution function of Ouchi et al. 
(2004b), and estimate the correlation lengths, ro, of spa- 
tial two-point correlation function, £ = (r/ro)~ 7 , where 
7 = (3+1. Table 1 presents the best- fit parameters, 
A u and 0, together with r . These r are consistent 
with those obtained by Ouchi et al. (2004b) as well as by 
Hildebrandt et al. (2004) and Kashikawa et al. (2005). 
However, our results arc not consistent with those of 
small-sky surveys in HDF, if we assume that ACF does 
not significantly evolve between z = 3 and 4. For exam- 
ples, Giavalisco & Dickinson (2001) find a small corre- 
lation length of r = l-Oj^/hoo Mpc for z = 3 LBGs ' 
while we find a larger value, r = 3. 8+02 ^00 Mpc, for 
our i' < 27.5 LBGs whose number density is comparable 
to that of Giavalisco & Dickinson (2001). We restrict our 
power-law fitting to the same narrow range as Giavalisco 
& Dickinson (2001) (1" < 9 < 20"), and then we obtain 
the consistent results within errors, i.e. r = 1.3±0.3ft7/ g 

9 Note that bootstrap errors of the ACF are assumed to be 
independent. 



Mpc and = 1.9 ± 0.2, due to the fitting only to the 
small-scale excess of the ACF (see Kravtsov et al. 2004) . 
Similarly, the correlation length of red galaxies in HDF-S 
(ro = 8/i^ q Mpc; Daddi et al. 2003) is probably overes- 
timated by the extrapolation from a bump of small-scale 
ACF with a relatively flat slope of = 0.8, which is also 
claimed by the model of Zheng (2004) . 

3.3. Comparison with a Halo Model 

We fit the halo model of Hamana et al. (2004) to the 
observed w(6) and number density, n, simultaneously. 
This model predicts the u>{9) and n of galaxies con- 
tributed by a combination of the 1-halo and 2-halo terms 
in the framework of the CDM model. The best-fit mod- 
els are shown in Figure 3 and Table 1. These models 
account for the overall shape of our ACFs, i.e., the small- 
scale excess as well as the large-scale clustering (see also 
Lee et al. 2005), although there remain large residuals 9 
(e.g. x 2 / dof = 3-0 for i' < 27.5 LBGs). Reducing these 
residuals results in a decrease in the combined likelihood 
(oj(9) + n) from the best-fit value. The large residuals 
imply that we need a more precise model for our LBGs. 
For implications of the model fitting, Table 1 summarizes 
the average number of LBGs in a halo, (N g ), and the av- 
erage masses of the halo, (Mh), (Hamana et al. 2004) for 
the best-fit models. The average mass of hosting halos 
monotonically decreases from 2 x lO 12 /^ M Q (i' < 24.5) 
to 6 x 10 n h^M Q (i' < 27.5). The average number of 
LBGs in a halo is less than unity, (N g ) ~ 0.2 — 0.7, while 
the model ACF in Figure 3 shows a significant 1-halo 
term produced by multiple LBGs in one halo. This im- 
plies that majority of halos with an average mass have no 
LBG and only some halos host one or multiple LBG(s). 

We thank M. Fall, M. Giavalisco, K. Lee, S. Okamura, 
and Z. Zheng for helpful comments and discussion. 
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TABLE 1 

Summary of Clustering Properties 



Conventional Power-Law Approx. Modcl e 



i' AB N(<i'r n(<i') h f3 c r„ c f3 L d {Ng) log <M h ) 

(mag) (h% Mpc" 3 ) (arcsec' 3 ) (h^ Mpc) {h^j M©) 



24.5 


239 


9.8 ± 1.6 x 10~ 5 


10.5 ±8.2 


1.1 ±0.4 




~ 1.6 


2 +0 - 2 


12 3+ - 1 


25.0 


808 


2.8 ±0.3 x 10~ 4 


5.0 ±9.1 


0.9 ±0.3 


5 5+ 1 ' 7 
—2.1 


0.9 ±0.6 


o.3ir 3 


12 3+ ' 1 
lz -°-0.2 


25.5 


2231 


6.4 ±0.6 x 10~ 4 


3.1 ± 1.6 


0.8 ±0.1 


5 0+ ' 7 
°- u -0.8 


0.8 ±0.4 






26.0 


4891 


1.3 ±0.1 x 10~ 3 


2.6 ±0.6 


0.8 ±0.1 


5 0+ ' 4 
°- u -0.4 


1.0 ±0.2 




I2.0l° ;i 


26.5 


8639 


2.2 ±0.3 x 10~ 3 


0.6 ±0.1 


0.5 ±0.1 


4.8t° j 


0.7 ±0.2 




11 q+0.05 


27.0 


12921 


3.7 ±0.7 x 10~ 3 


0.8 ±0.1 


0.6 ±0.1 




0.7 ±0.1 


6+° 1 
U.O_ Q 2 


n c+0.07 
il - 8 -0.04 


27.5 


16920 


5.8 ± 1.4 x 10~ 3 


0.5 ± 0.1 


0.5 ±0.1 


o O+0.2 
3.»_ () 2 


0.6 ±0.1 


7+ 02 
u -'-o.i 


ii c+0.02 
il - 8 -0.05 



a Cumulative numbers. Differential surface densities are 0.002 ± 0.001, 0.014 ± 0.002, 0.049 ± 0.004, 0.158 ± 0.007, 0.395 ± 0.011, 0.739 ± 0.014, 
1.041 ± 0.017, 1.189 ± 0.018, and 1.111 ± 0.018 arcmin" 2 (0.5mag) _1 for % = 23.25, 23.75, 24.25, 24.75, 25.25, 25.75, 26.25, 26.75, and 27.25, 
respectively, which arc consistent with previous measurements (e.g. Ouchi ct al. 2004a). 

^Cumulative number density calculated from luminosity function of Giavalisco (2005). 

c Rcsults from the conventional power-law approximation, i.e. uj (0) = A^(8- 13 - IC/A W ), over 2" — 1000". For integral constraints, IC, we apply 
IC/A M = [3, 14, 21, 28, 364, 154, 293] x 10" 4 for i' = [24.5, 25.0, 25.5, 26.0, 26.5, 27.0, 27.5]. 
^Power-law slope for the fit of lo — A^j^O over 40" — 400" with no IC correction. 
c x 2 /dof = [0.7,0.4,2.5,6.9,8.3,7.1,3.0] for i' = [24.5,25.0,25.5,26.0,26.5,27.0,27.5]. 



